Accurate Single Image Multi-modal Camera Pose Estimation
نویسندگان
چکیده
A well known problem in photogrammetry and computer vision is the precise and robust determination of camera poses with respect to a given 3D model. In this work we propose a novel multi-modal method for single image camera pose estimation with respect to 3D models with intensity information (e.g., LiDAR data with reflectance information). We utilize a direct point based rendering approach to generate synthetic 2D views from 3D datasets in order to bridge the dimensionality gap. The proposed method then establishes 2D/2D point and local region correspondences based on a novel self-similarity distance measure. Correct correspondences are robustly identified by searching for small regions with a similar geometric relationship of local self-similarities using a Generalized Hough Transform. After backprojection of the generated features into 3D a standard Perspective-n-Points problem is solved to yield an initial camera pose. The pose is then accurately refined using an intensity based 2D/3D registration approach. An evaluation on Vis/IR 2D and airborne and terrestrial 3D datasets shows that the proposed method is applicable to a wide range of different sensor types. In addition, the approach outperforms standard global multi-modal 2D/3D registration approaches based on Mutual Information with respect to robustness and speed. Potential applications are widespread and include for instance multispectral texturing of 3D models, SLAM applications, sensor data fusion and multi-spectral camera calibration and super-resolution applications.
منابع مشابه
Camera Pose Estimation in Unknown Environments using a Sequence of Wide-Baseline Monocular Images
In this paper, a feature-based technique for the camera pose estimation in a sequence of wide-baseline images has been proposed. Camera pose estimation is an important issue in many computer vision and robotics applications, such as, augmented reality and visual SLAM. The proposed method can track captured images taken by hand-held camera in room-sized workspaces with maximum scene depth of 3-4...
متن کاملEvaluation of Relative Pose Estimation Methods for Multi-camera Setups
The fully automatic and reliable calculation of the relative camera pose from image correspondences is one of the challenging tasks in photogrammetry and computer vision. The problem has not been solved satisfactorily, e.g. in case of critical camera motions or when observing special point configurations. Furthermore, some methods provide multiple solutions for the relative orientation. In this...
متن کاملPseudo-linearizing collinearity constraint for accurate pose estimation from a single image
The goal of this paper is twofold: firstly, we propose a novel interpretation for collinearity in the process of camera pose estimation from given correspondences between a 3D model and its 2D projective image. In contrast with the existing interpretations for collinearity, the focus of expansion (FOE) theory is a special case of our novel interpretation for collinearity and besides the project...
متن کاملExploiting Random RGB and Sparse Features for Camera Pose Estimation
We address the problem of estimating camera pose relative to a known scene, given a single RGB image. We extend recent advances in scene coordinate regression forests for camera relocalization in RGB-D images to use RGB features, enabling camera relocalization from a single RGB image. Furthermore, we integrate random RGB features and sparse feature matching in an efficient and accurate way, bro...
متن کاملCamera Pose Estimation by Alignment from a Single Mountain Image
We present an alignment-based method for recovering camera position and orientation parameters from a single mountain image and digital elevation map. Camera pose estimation is achieved even without any initial position or orientation parameter estimate and requires only that the camera height above ground be known beforehand. It is also robust to partial occlusion. Using mountain peaks as feat...
متن کامل